Software Tools for Earth and Environmental Science - Week 3

YSB 801E

October 4, 2019

Data Sources-Download and NCL

  • Syllabus, Book and Last Week

  • Data and Metadata

  • Data Formats

  • Data Sources

  • Data Download

  • NCL, nco and cdo

  • Next Week

Syllabus, Book and Last Week

Syllabus

Extended Syllabus PDF

Book

The Book of R - PDF

Last Week

Course Home Page LINK

Week 2 - Presentation LINK

3th Week - Extended Syllabus

Repeat - Linux

webminal.org

Repeat and Practice

  • Direction Commands
    • pwd (Print Working Directory)
    • ls (List Directories)
    • cd (Change Directory)
    • mkdir (Make Directory)
  • File Commands
    • touch
    • cat (Concatenate)
    • rm (Remove)
    • cp (Copy)
    • mv (Move)
  • vi command
    • esc and i
    • :q and :q! and :qw

Practice

  1. Learn where you are (Print your working directory)
  2. Look at inside (list all documents and directories)
  3. Create a new folder (make a directory,<my_new_dir>)
  4. Go to the <my_new_dir> (change your directory)
  5. Create a new file (touch it, file name : <my_new_file>)
  6. Open your file with text editor (vi <my_new_file>)
  7. Activate Insert mode (with i)
  8. Write this line:
  9. Write/Save and Quit (:wq)
  10. Change your new file name (move <my_new_file.sh>)
  11. Run the script <my_new_file.sh> (bash .sh)
  12. Turn back parent directory (cd ..)
  13. Delete all files and folders (remove -rf)

Data and Metadata

What is Data?

Data are things, known or assumed as facts, making the basis of reasoning or calculation.

What is Metadata?

Metadata is information about data.

What is Metadata?

Data Formats

Data Formats

  • Data Types

  • Data Set

  • Data Formats

LINK

scroll down

Data Sources

Data Sources

  • Earthdata
  • KNMI
  • Wordclim
  • ERA
  • GFS
  • ESGF
  • CRU
  • E-OBS

LINK

Data Download

Data Download

  • Click
  • ftp, sftp, https, ssh
  • wget

Click

KNMI Climate Explorer

ftp, sftp, https

  • ftp - File Transfer Protocol
  • sftp - Secure File Transfer Protocol
  • https - Hypertext Transfer Protocol Secure
  • ssh - Secure Shell

BONUS - FileZilla

ssh.itu.edu.tr

cdo, nco and NCL

cdo, nco and NCL

  • cdo
  • nco
  • NCL

cdo

Climate Data Operator

2019-06-13: 1.9.7

LINK

cdo

era5_t2m.nc

cdo

cdo yearmonmean era5_t2m.nc era5_t2m_yearmonmean.nc
era5_t2m_yearmonmean.nc

cdo

cdo splitmon era5_t2m.nc era5_t2m_splitmon
era5_t2m_splitmon10.nc

cdo

cdo sellonlatbox,26,-45,36,42 era5_t2m.nc era5_t2m_TR.nc
era5_t2m_TR.nc

cdo

cdo seasmean era5_t2m.nc era5_t2m_seasmean.nc
era5_t2m_seasmean.nc

nco

netCDF Operator

2019 Jul 01: 4.8.1

PDF

nco

ncdiff era5_t2m_splitmon03.nc era5_t2m_splitmon04.nc era5_t2m_splitmon0304_ncdiff.nc
era5_t2m_splitmon0304_ncdiff.nc

NCL

NCAR (National Center for Atmospheric Research) Command Language

LINK

NCL

NCL

NCL

NCL - Vapor

BONUS - ncview

netCDF visual browser

LINK

Next (4th) Week

Syllabus

Extended Syllabus

BOOK

The Book of R - The Language - Getting Started

(Part 1, Section 1, Pg. 3-14)

The Book of R - PDF

Homework

  • Download R and R Studio

Udemy - R Basics - LINK

  • Introduction to R

Datacamp - Introduction to R - Intro to basics (FREE) - LINK

QUIZ

R - Getting Started